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ADAPTIVE COMPUTATION, PART I 


Adaptive computation overlaps with the much sexier-sounding field of artifi- 
cial life. But artificial life includes robotics and "wetware,”" or life in 
test tubes, and it raises lots of philosophical questions. Meanwhile, adap- 
tive computation includes not just computer-based artificial life but also 
other applications of neural nets, genetic algorithms and other exotic pro- 
gramming techniques; it raises technical, mathematical questions. Just 
trying to define the distinction raises hackles on both sides, and is like 
trying to compare "artificial intelligence” with such handy techniques as 
rule-based programming, case-based reasoning/search and grammatical parsing. 


The basic idea is software that adapts or learns instead of being pro- 
grammed. Is the term "artificial life" just another marketing mistake, an 
overhyping of a set of sound but not magic techniques that will leave a lot 
of would-be visionaries disappointed? It could be, if it’s touted as suffi- 
cient by itself to handle all the programming challenges of the next decade. 
On the other hand, adaptive computation is a powerful approach to some pro- 


gramming problems difficult to solve the old way. 


(For an earlier look at 


the topic, see Release 1.0, 6-89, and also 7-87 on neural nets.) 


Forget the terminology: 


Since this is such a broad subject, we will cover 
it over two issues with examples rather than definitions. 


This month’s is- 


sue deals with one bona fide instance of artificial life and with some 
market/ecosystem models, while the May issue will cover the use of adaptive 
computation techniques, specifically genetic algorithms, to solve specific 


problems. 


We will also consider viruses and cover the forthcoming "Biology 


and economics" Santa Fe Institute workshop on cross-generation transfer of 
non-genetic assets such as knowledge, wealth and other entitlements. 


ALife is as ALife does 


Artificial life isn’t yet a carefully 
canonized field. It starts with the no- 
tion that life is not a property of car- 
bon, hydrogen and nitrogen, but a func- 
tion of how things behave: They repro- 
duce (imperfectly); they grow, absorbing 
and transforming material from their en- 
vironments; they compete; they evolve; 
they learn. None of these functions re- 
quires any particular physical mani- 
festation; in fact, you can do all of 
them on a computer. Adaptive computa- 
tion uses many of these techniques, 
without the metaphysics. = 
LIFE BEGINS IN SANTA FE! 


INSIDE 
ADAPTIVE COMPUTATION 
And artificial life. 
Box: Santa Fe. 
Why we care. 
ARTIFICIAL WORLDS 
Tierra. 


Interlude: Nature vs. 
ARTIFICIAL MARKETS 
Echo. 


Gas in his eyes. 
Origins of money. 
Midterm review. 
RESOURCES & CALENDAR 25-27 
Names, phones, books, dates. 


EDvENTURE HoLpINcGS Inc. 375 PARK AVENUE, New York, NY 10152 


(212) 758-3434 


2 
Complex oaks from simple acorns grow 


The promise of adaptive computation is the ability to adapt or evolve solu- 
tions to complex problems that can’t be handled by simple data manipulation 
or by single calculations, however complex. Appropriate tasks include com- 
plex problems of design, planning, scheduling, modeling, code optimization, 
pricing and many other tasks that aren’t even thought to be computer prob- 
lems in the first place. One of the most obvious is the allocation of com- 
puter resources through market-like mechanisms, as in the Spawn project at 
Xerox PARC (see Release 1.0, 6-89); this will be a large field as we move 
towards globally networked systems, massively parallel computing and the 
like. (We'll also need better immunity -- not invulnerability -- against 
evolving viruses; see our next issue.) On the other hand, adaptive com- 
putation isn’t appropriate for accounting or transaction-processing, which 
follow defined rules and need to be explicitly correct for legal reasons. 


Early life 


Use of these techniques is still in the early stages; this newsletter 
covers some provocative research, mostly at the Santa Fe Institute, rather 
than fielded systems. The few working systems are generally based on 
neural nets, but GA-based systems are now appearing. Neural nets adapt by 
changing weights (numerical parameters) in response to feedback -- wrong 
answer, right answer, and so forth -- mostly for pattern-recognition tasks 
such as assessing credit risks or recognizing handwritten characters. 
Notable among these are Nestor’s handwriting and signature recognition sys- 
tems, and Pavilion's Process Insight, based on work at MCC. Process In- 
sight manages chemical production processes, adjusting temperature and 
other parameters according to patterns determined by a neural net. ALL 
these efforts are frequently cited, since the range of working systems is 
limited (cf. Eliza, XCON and the notorious wine advisor in AI). 


So far, computers and people interact, but with no regular 
feedback loop. That is, some people design software and others 
learn to use it as is. What about computers and people actual- 
ly adapting to each other in a tight feedback loop? 


Genetic algorithms have been used to identify features for pattern recogni- 
tion and for engineering or scheduling tasks. GA consultant (perhaps the 
only one around) Lawrence Davis cites a number of examples, including a 
Bureau of Mines machine for refining copper with parameters such as tube 
sizes and flow rates determined by a GA; a Navy system for scheduling F-16 
tryouts (and all the accompanying equipment) based on a GA; and a start-up- 
phase scheduler being developed by Coors to schedule fulfillment and ship- 
ment of orders. GAs are also being used in other more complex but still ex- 
perimental situations which we will describe next month. 


Much work on handwriting is in the works, and we believe a number of finan- 
cial institutions use neural nets in credit decisions but are loath to talk 
about it (which means it works well enough to be a competitive advantage, or 
it works so poorly that they're embarrassed). Several investment firms, 
such as Wallace-Anthony of Beverly Hills and start-up Prediction Company, 
are using adaptive computation techniques for financial transactions. 
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For further research 


Neural networks work well enough to establish the credibility of the bio- 
logical approach. However, while neural nets adapt, they are fixed code 
structures that simply change their variables. They do not replicate, nor 
do they change form in any substantive way. They change weights and even 
perhaps structure, but not architecture. They are built, rather than grown 
or cultivated. 


Adaptive computation and especially artificial life go beyond neural nets to 
techniques that are substantially more "life-like" (although that’s a dis- 
tinction a neural-netter might argue with), and that generate structures 
that are not determined in advance by the programmer. As John Koza of Stan- 
ford and the Third Millennium Venture Capital argues eloquently in his book 
Genetic Programming, the goal of the field is a general way to produce pro- 
grams, not specific techniques: 


".,.existing methods of machine learning, artificial intelligence, self- 
improving systems, self-organizing systems, neural networks and induction 
do not seek solutions in the form of computer programs. Instead, exist- 
ing paradigms involve specialized structures which are nothing like com- 
puter programs (e.g., weight vectors for neural networks, decision trees, 
formal grammars, frames, schemata, conceptual clusters, coefficients for 
polynomials, production rules, chromosome strings in the conventional ge- 
netic algorithm, and concept sets). Each of these specialized structures 
can facilitate the solution of certain particular problems... [but] human 
programmers do not regard these specialized structures as having the 
flexibility necessary... If we are interested in getting computers to 
solve problems without being explicitly programmed, the structures that 
we really need are computer programs." 


The techniques listed above are valuable components, and may be part of a 
program, but they lack the flexibility of true programs, with hierarchies, 
structures, subprograms that can be reused, control flows, ete. (This is 
the most radical view of adaptive computation, to be addressed in our May 
issue. For now, just keep it in mind.) 


The basis of much computer-based artificial life is genetic algorithms that 
foster evolution of solutions to particular problems (a search over a "“fit- 
ness landscape"). Solution components alter and combine; most do terribly, 
but the better ones stick around to produce ever better solutions. "The" 
genetic algorithm is a generic term for algorithms that control the genera- 
tion, variation, adaptation and selection of the solutions to a problem: 

The result could be a single algorithm, a program, or even a set of con- 
stants (although this is the best approach only when the search space is es- 
pecially large, noisy and irregular). 


If this strikes you as hard to believe and impractical, consider how we our- 
selves must have evolved. As described below, these systems frequently end 
up surprising and delighting their creators (as humans surprised god -- and 
sometimes appalled him?). Like any new field, adaptive computation is 
filled with people trying a variety of approaches, some simple-minded and 
illustrative, others complex and not too successful. But in the end, the 
field is incredibly broad -- and should evolve not to a single answer, but 
to a productive diversity of approaches. = page 6 
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COMMERCIAL INTERRUPTION: THE BEST THING ABOUT ALIFE IS SANTA FE 


The Santa Fe Institute was founded in 1984 in a sort of spontaneous gen- 
eration that involved George Cowan, its first president, and six of his 
colleagues from the Los Alamos National Laboratory. Other early figures 
included man-about-physics Murray Gell-Mann. They sat around and talked 
about the idea, then held a workshop to test the level of interest in an 
interdisciplinary institute devoted to the study of complex, adaptive 
systems. The idea survived, and the group has attracted funds to live 
year to year (close to $3 million annually) but no permanent endowment. 


With a science board of 50 and a trustees’ board of 40 (including Esther 
Dyson), the Institute by default has become the premier organization de- 
voted to the field. It is looking for a permanent chairman; the acting 
chairman is Jim Pelkey, a venture capitalist and consultant (and former 
ceo of Sorcim) who moved to Santa Fe two years ago. The Institute has a 
resident staff of about 25 including 10 scientists, and a visiting facul- 
ty ranging from 15 to 40 scientists from month to month. Much of its 
work is carried out through workshops, symposiums and other meetings, 
where scholars meet others from different fields to share ideas. Its 
major fields of study are economics (which somehow has the easier time 
getting funded) and a number of harder-to-categorize projects such as 
those described here. One way or another, all depend on computers. 


SFI's major purpose is to keep on experimenting. SFI meetings are fun: 
In most scientific discussions, when you ask questions, the answer is, 
"We don’t know because..." there’s some serious impediment to finding 
out. In our own business of software, it's usually, "No one’s done it 
yet, and it will take a few years to happen.” Or, "They're working on 
it, but it’s late." At the Institute, the answer is usually, "Well, 
let's try that." 


A list of some people we ran into on our last visit gives a flavor of the 
place: Lev Zhivotovsky, a Moscow geneticist; Carl Djerassi, founder of 
Syntex; Bob Maxfield, co-founder of Rolm Corporation; Chris Langton, 
prime mover of artificial life from Los Alamos; Melanie Mitchell, resi- 
dent director of the Institute's adaptive computation program, who has 
worked with John Holland and Doug Hofstadter at the University of Mich- 
igan on a variety of AI projects; Danny Hillis, founder of Thinking Ma- 
chines Corporation and designer of its Connection Machines; Doug Carl- 
ston, founder of Broderbund; Marc Feldman, a Stanford population geneti- 
cist; Tom Ray and John Holland, described in this issue; Will Wright, 
creator of SimCity and other games; Stuart Kauffman (cousin of Objective 
Software's Rich Melmon), MacArthur Fellow and theoretical biologist; 
David Liddle, now setting up Interval Research; and Doyne Farmer, founder 
of Prediction Company, which will use adaptive computation to direct 
trading activities in financial markets. 


We were there for the Institute’s recent founding workshop on adaptive 
computation. The purpose was both to share research, and for the Insti- 
tute to survey current work in order to shape its adaptive computation 
program for the next few years. 


Release 1.0 28 April 1992 


NATURAL HISTORY OF ARTIFICIAL LIFE 


Artificial life gained visibility with the first conference on artificial 
life in September of 1987, sponsored by the Santa Fe Institute and Los 
Alamos National Lab’s Center for Nonlinear Studies. (Call it Los Alamos 
Nonlinear Labs?) That conference attracted about 150 people; the second 
one, in 1990, attracted 350; and the next one, this June 15 to 19, will 
be limited to 500. Also in June several books on ALife will appear, in- 
cluding one by "Hackers" author Steve Levy. In short, the field is about 
to be very fashionable. Although its successes so far are mostly demon- 
strations, experiments and projects, the field has caught the attention 
of (and funding from) the likes of IBM, Apple, DEC, Sun -- and Citibank, 
financial house O'Connor & Associates and others. 


The sociology of the field is fascinating in itself: Nobel-winners, bio- 
logists, sociologists, physicists, economists and psychologists, many of 
them Nobel-winners, come into close contact with each other as well as 
with social butterflies, science-fiction writers and science salon- 
keepers. Indeed, the field gets much of its vitality from this cross- 
pollination (to use a "life" metaphor loosely). Moreover, many leading 
complex-systems people aren't quite respectable in their own fields: 
They're considered strange, weird, not-mainstream and worse by their col- 
leagues. At the Institute, by contrast, they get respect, but there’s 
the opposite problem: The physicists don’t always understand biology as 
well as they think they do, and vice versa. One of the Institute’s major 
contributions is exposing the different disciplines to each other. 


Hillis on holiday 


Another early contribution to the field was Danny Hillis’s work on gener- 
ating sort algorithms (for 16 elements) by evolution, which he somehow 
fit into his role as founder and chief scientist of Thinking Machines 
Corporation. (See the PC Forum proceedings for 1990.) Using a genetic 
algorithm and a Connection Machine, he started with a set of compares as 
raw material. The program created new sequences to be tested against 
random sequences of 16 numbers, and the best scores won each round. The 
better-than-average scorers were then split and recombined at arbitrary 
points, and the population improved gradually. The resulting program was 
quite compact, involving a sequence of compares, but it did the job in 65 
steps, almost matching the world record of 60. This is a classic example 
of optimization. It took a few hours on a Connection Machine. 


Hillis later refined the approach with co-evolving "parasites" that posed 
ever-harder sorting problems; the parasites survived by stumping the sort 
algorithms. Although Hillis still hasn't beaten the 60-step record, he 
got it down to 61 with co-evolution. (Strictly speaking, these aren’t 
parasites in the sense of using the host’s resources directly, but they 
perform the same ecological function of stretching the hosts’ skills and 
testing their fitness.) Hillis is now working at Thinking Machines’ 
Santa Fe office, which serves nearby Los Alamos and Sandia, and also 
spends time informally at the Santa Fe Institute where he's a member of 
the science board. 


o 
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For example, you might use genetic algorithms to optimize performance of 
some small part of an application where performance is key. Or you might 
use adaptive computation to derive the best solution to some design con- 
straints. You could use adaptive models to track and predict financial 
markets and make investment decisions. Or you could use a market system to 
allocate resources. 


Vs. artificial intelligence 


Like artificial intelligence, adaptive computation is likely to show up most 
fruitfully not as giant "adaptive computation" applications, but as compo- 
nents of applications or as techniques used in building or refining tradi- 
tional applications. (Koza would argue that we need to produce entire pro- 
grams, but those will still likely be components of larger systems.) 


Also like artificial intelligence, AC is not a single field, but rather a 
set of techniques and approaches. In short, it’s using computer programs to 
program or at least adapt themselves, opening up possibilities that simply 
didn't exist before the advent of computers. These techniques can also be 
applied outside the realm of computers to model almost any complex system, 
most notably economics and biology, social phenomena, epidemiology, etc. -- 
in short, phenomena that previously were considered unmodelable. 


The greatest applications are likely to be ones we don’t yet 
expect. There’s a simple example that gives a flavor, says 
wizard John Holland, widely credited with inventing genetic al- 
gorithms: Until the late 1890s, weather prediction was a prim- 
itive art, even though forecasters could receive data by tele- 
graph from remote locations, and make some predictions on typi- 
cal weather patterns, such as wind directions. In the 1990s, 
however, meteorologist Vilhelm Bjerknes came up with the con- 
cept of fronts and air masses, and weather prediction took a 
quantum leap towards accuracy close to what we have today. The 
simple idea of fronts -- a way to organize the data -- mattered 
far more than any progress we’ve made since in collecting the 
data. In the same way, better models rather than more data may 
make a substantial difference in understanding and managing 
economics, biology, programming and other "soft" disciplines. 


Why we care 


While all this sounds far from the mainstream software business we know 
today, that’s only because the computer/software community has solved the 
easy problems first. The big market is the one we haven’t addressed yet, of 
the harder problems we haven’t yet tackled. Those who can solve them will 
do well -- and will evolve on to bigger things. 


In fact, there are two ways adaptive computation is important to the soft- 
ware industry: First, it can help software and users developers directly. 
It can make programming easier, as a new way of automatic programming for 
tasks such as optimization, pattern recognition, machine learning, modeling, 
etc. In real-time, such systems can also control and optimize allocation of 
computer resources. 
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The second use of adaptive computation is fundamentally more interesting, 
and to customers as well as to software vendors. That is making better 
(software) models to predict, analyze and manage real phenomena. This in- 
cludes everything from yield management (see Release 1.0, 2-89) to invest- 
ment decisions, genetic engineering, the immune system, drug design, tax 
policy, etc. If the task of the future is not automation but design of sys- 
tems, we can use many of the techniques of artificial life. We've done very 
well applying simple models to simple phenomena; we may do even better ap- 
plying these more complex (albeit simple-grained) models to more complex 
phenomena. Clearly, we can’t control complex systems from the top (as the 
Communists, IBM and other groups have finally learned). Instead, we have to 
control them by rules in the units themselves (profit maximization, reli- 
gious rules, etc.) and in their environments -- tax policies, laws, etc. 
Top-down strictures work for long only if they somehow reinforce or channel 
the internal inclinations of the individual components. 


How it works 


Information theory posits the idea of the smallest amount of information re- 
quired to fully describe a system. The actual information can be quite 
small, just a few equations and objects -- but they can lead to a seemingly 
complex system over a large number of iterations with feedback. The feed- 
back is key. The best example is the information in a single human genome 
-- which led to such marvels as Mozart, Einstein and of course Juan and 
Alice. The complexity in such systems is built in, not compressed, but it 
can be realized only through the execution of millions of calculations. In 
natural life, such complex systems thousands of generations and millennia to 
unfold. The computer allows us to speed up the process, compressing time, 
much as it allowed us to compress data by summarizing, averaging and other- 
wise squeezing data. The parallels are not exact since the two processes 
are quite different -- which is what makes adaptive computation interesting. 


On the one hand, you have evolution, following the very simple rule: "Favor 
the ones that are lucky enough to survive, and reproduce them with varia- 
tions. Repeat." This is the basis of the genetic algorithm, which (in var- 
fous forms) follows the cycle of generate a population, evaluate individuals 
in the population against a given "fitness" measure or problem, and create a 
new generation based on the best performers of the current generation. 
Repeat until done. Obviously, a few details are missing... 


On the other hand, you can cultivate complex markets, where each entity is 
following rules aimed at (more or less) of maximizing profit or some other 
measure of fitness. These rules are conscious, but they are developed and 
executed at the individual level. Interestingly, this does not lead to 
sameness but rather to diversity; complex adaptive systems consist of groups 
of elements, and everything works better if they don’t all follow precisely 
the same rules. 


In either case, there's a feedback loop inside the system, so the programmer 
or user (in theory, at least) doesn’t need to be involved once the system is 
set up. The "system" may include external data sources and sensors; defin- 
ing the extent of a system is a nontrivial matter. (What if the programmer 
is imside the system? See footnote on page 15.) 


But enough theory. Let’s do a field survey... 
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ARTIFICIAL WORLDS: A FIELD SCIENTIST IN TIERRA COGNITA 


One of the more exciting research efforts at Santa Fe is Tierra, developed 
by naturalist Tom Ray. Ray, 37, spent 16 years of his life in the Costa 
Rica jungle. During that time, in 1980, he heard that you could build self- 
replicating software, but that idea lay fallow for almost ten years while he 
continued to study beetles, butterflies, ants and plants. His work con- 
vinced him of the awesome power of evolution to create complexity and diver- 
sity, but in Costa Rica he saw only its results, not the process in action. 


Meanwhile, through a sequence of probably inevitable steps, he started to 
use a computer, The whole idea of artificial life seemed too theoretical 
until the magic moment almost three years ago when he used a debugger (Bor- 
land's Turbo C compiler and debugger, for what it’s worth). "This was the 
first time I could see what was physically going on inside the computer," he 
says. It was a jungle in there. There was a physical environment, there 
were resources, and there were programs interacting with each other and with 
the environment. 


Within a few months he lost interest in his former life: "I was fighting an 
uphill battle for tenure at the University of Delaware, but suddenly I was 
no longer even interested in the work I was doing." [News flash: He got 
tenure anyway, in late 1990.] Instead, he began to build Tierra -- an at- 
tempt to create an artificial rain forest, so to speak, inside a computer. 
To get started, he took a trip to Los Alamos to visit its artificial life 
group, much of it now moved to Santa Fe. 


The group was somewhat skeptical: Until then, most ALife work managed evo- 
lution according to externally defined fitness criteria and resources and 
allowed mutations; ALife creatures typically competed with each other by in- 
teracting with the environment (a scoring program) to score higher. These 
systems were actually models, with resources allocated by a scoring system 
and with carefully structured mutations, rather than a real, digital envi- 
ronment, which seemed to be too brittle. By contrast, Ray's life would have 
to fend for itself once he stuck it into Tierra. All it knew how to do was 
grab resources and self-replicate, with random mutations. 


On the other hand, his approach had some distinct advantages: Rather than 
talk to computer memory locations or a central program, Tierra’s organisms 
by means of templates that mark each organism's boundaries and that separate 
internal code sequences -- much as proteins, cells and antibodies recognize 
each other in a "wet" living thing, finding each other and locking on to 
complementary surfaces. This avoids the need for the creatures’ code to 
contain specific memory locations -- which would indeed be brittle. 


Overnight success 


As Ray explains it, there were two exciting periods in the development of 
life on earth: the origin of life within the primordial soup 3 billion years 
ago, for which we have only circumstantial evidence; and the extraordinary 
diversification of life only 600 million years ago during the Cambrian peri- 
od, from which we have a broad fossil record. In Tierra, Ray skipped the 
first 3 billion years, when organisms slowly learned how to replicate, and 
set up a "just-pre-Cambrian" environment, with a single-cell organism/ 
program that could replicate itself imperfectly but do little else. 
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To his surprise, it did what it was supposed to do and evolved without prod- 
ding. "What I got was what I dreamed of, not what I expected. I expected 
to work for years to get what happened on the first run," says Ray. In 
fact, he has spent much of the two years since 3 January 1990 poking through 
the records of that first overnight run of 250 generations and a couple of 
longer follow-ons with roughly the same parameters and conditions. The ini- 
tial program/creature evolved as it mutated and replicated. The details 
were surprisingly predictable: parasitism, immunity, hyperparasitism, cheat- 
ing and even sex. Yet all these phenomena make perfect sense when you exam- 
ine them -- as they do in natural life. 


Ray is different from most people involved in ALife in that 
he’s a biologist rather than a computer scientist. Most 
ALifers came to the field from fooling around with neural nets, 
algorithms and the like, while Ray worked in the rain forest of 
Costa Rica, sweating and being rained on. But, he notes, 
"older biologists tend to stay in their offices and send grad- 
uate students out into the field. Perhaps I was ready for that 
too." He has now combined the physical comforts of the US with 
the wildness of a new jungle inside the computer. He put in 
his hand and found mud, where most people find math and models. 


Design for living 


Tierra starts with a single, simple creature 80 lines long; each line is a 
single 5-bit instruction or one of two "no-op instructions" (1 or 0, de 
facto). The no-op instructions, in sequences of four, act as templates to 
identify the beginning and end of an organism or sections within it, such as 
the 39-line copy procedure. An organism can use the templates to identify 
itself for replication or to jump to the appropriate section of code for ex- 
ecution -- whether it’s in itself or in a nearby organism. The size of the 
area it searches is an external, adjustable parameter; it lets organisms in- 
teract and it also lets parasites and symbionts use each other's code. 


The working instructions are very simple, and there are only 30 of them 
Chence the 5 bits). For example, there are instructions for finding empty 
memory, finding the beginning and end of oneself (to know what to repli- 
cate), and so forth. Replication is implemented as a sequence -- "count 
your own number of lines, find and reserve an empty memory area of the re- 
quired size, store a copy of a line in the new location," iterating the last 
step the appropriate number of times -- to produce a child organism. That 
child organism, of course, includes a copy of the instructions for repli- 
cation which were executed to create it. 


All together, these local instructions carry out the global activities of 
Tierra rather than relying on management from a central control program. 
(In one concession to artificiality, the system runs on a virtual machine 
for security and portability.) The only central activity is the Reaper, a 
sort of live-garbage collector, which kills organisms off in rough order of 
creation to keep memory from overflowing. An organism moves one place for- 
ward in the queue, ahead of others, by executing instructions that don’t 
work; thus buggy creatures die off early, usually before reproducing. 
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Memory and execution time are allocated centrally, but in strict sequence. 
The time-slicer is more a simulation of parallelism and resource constraint 
than central control. Each organism gets the same number of cycles, about 
25, or much less than needed to complete reproduction (about 800 for an 80- 
line creature). This favors short organisms, which take fewer cycles to 
reproduce: A typical organism makes only one copy of itself before it dies, 
but some short, lucky ones manage two. Partly completed children are col- 
lected by the Reaper when their parents die. By allocating time according 
to size, you could skew the world differently, of course. 
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In the beginning... 


Thus all that Ray put into Tierra was an organism with instructions for 
identifying itself and component code sections, counting its own length, 
finding nearby empty memory and replicating itself, one line at a time, into 
the new space. The "goal" of the organism was to execute instructions, tak- 
ing machine time to do so. As noted, a key difference from most ALife was 
addressing by template, not by memory location. This keeps specific memory 
locations out of the code and allows the organisms to interact directly. 


The space, 60K in the initial experiment (or enough for about 400 creatures 
and another 400 or so in the process of being replicated) filled up rapidly 
with descendants of the first creature, of course. After just a few cycles, 
memory was full, and the overflow was emptied by the Reaper. The popula- 
tion, instead of expanding, started to change composition. 
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Daear aaan aaaea naea ereere aaan eranen arnan aaan eeaeee a 
Grammar and mutations 


In any such system, you need a grammar for the changes. Most random muta- 
tions to computer programs would stop them working; typical code is brittle. 
You can’t just change actual random bits in the code, because your chances 
of getting anything workable are minimal. (Fn tre dame wan, wnrds wigh 
ranuom ccanges go lenters dob’t usutlly efd ut jaking duch sdnse.+) 


The Tierran language, by contrast, was written in an assembler specially de- 
signed so that a single bit-switch would usually produce a different but 
meaningful instruction. As noted, it’s extremely small, with only 32 in- 
structions represented as 5-bit strings. (By comparison, genes have 64 pos- 
sible "instructions," or sequences of three nucleotides forming 64 distinct 
codons, mapping into 20 possible amino acids; some different codons generate 
the same amino acids.) Thus it’s easy to get new and unexpected sequences 
of instructions, but most of them are at least executable. Some work out 
well; others turn out to be dysfunctional over time. That is, the errors 
and improvements operate on a broader scale than the individual mutations; 
it’s the combination of instructions rather than new instructions that pro- 
vides the variation. Thus, Tierra was able to get workable variation from 
mutations, without the sexual cross-over used in most genetic algorithms. 


The mutations operate on the executable 5-bit instructions, which map di- 
rectly to microcode which carries them out (and which happens to be virtual 
in this case). Ray also added in some random "flaws," errors in the micro- 


code execution, just to keep the world slightly off-kilter. "It turned out 
be important," he says. "It was when I introduced the flaws that I got the 
phenomenal optimizations." The flaws typically caused a creature to add or 


drop instructions from the genome, rather than change existing ones. 


As this indicates, in industrial-strength programming by evolution, we’ll 
need a sort of grammar for mutations -- but too strong a grammar would keep 
the system from being creative. There’s a delicate balance. If you only do 
what humans allow and predict, why use evolution at all? 


T œ 636 Inar = 188010 


TOnmu Ee I 
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Tierra’s population by 20acd eas | 
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Tierran generations pass. eh n l 
In this case, the 60s are esadrl | 

"normal" hosts, the 30s Easan ami 

are parasites and the 70s Garis | 

are hyperparasites. £235 Sa 


Siacw a i 
Debugging and analysis tools 
To explore his world, Ray used a number of observation tools. The simplest 
was a memory analyzer and visualization tool, which locates and counts the 


number of organisms by length and produces a graph for each generation. 
(See illustration.) For all its simplicity, it’s the key to letting non- 
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specialists "see" the power of artificial life, not just as abstract com- 
plexity nor as pretty pictures or exotic creatures, but as tangible, compre- 
hensible complexity. (But more and better tools are still needed.) 


Organisms are identified by size, and with a number indicating a specific 
genome. The original organism is 80aaa -- 80 lines long. The first 80-line 
variant is 80aab, and so on. 


The shifting lengths of the population’s individuals provide a fairly good 
picture of what’s happening. Each run of the system produces different 
results in detail, but most ended up remarkably similarly. After a while, 
parasites appear, although there are different kinds and different lengths 
that predominate over time in each run, depending on environmental condi- 
tions and on sheer chance (implemented as random mutations and flaws). Ray 
has not yet experimented with altering the time-slicing to apportion time 
according to size, which might make it a lot harder for parasites to get es- 
tablished. Further out in the run, beyond the initial parasites, it’s not 
yet clear whether the sequence of host -> parasite -> immune host -> hyper- 
parasite -> social hyperparasite repeats as tidily as it started. 


So far, Ray has had the time to examine only one run, of about 1 billion in- 
structions or 3000 generations, in detail. Of course, that’s not much. 
We've had about 100,000 generations of humans, after all, and millions of 
generations of mammals. 


A natural history of 80aaa and its descendants 


The original organism was 80 lines long and proliferated widely. (See dia- 
gram, page 10.) The first few generations were copies of the first crea- 
ture. After a few generations, however, some variants showed up, based on a 
mutation rate of 1 bit-flip per ten creatures per generation. Most appear 
as blips on the bar chart, because they have lost their replication code and 
die out, or they do everything else wrong and the Reaper gets them early. 


But parasites eventually emerged and survived. The largest parasite popula- 
tion was 45 segments long: an 80aaa that somehow split in the middle by 
changing a single bit in line 42, a no-operation instruction that is the 
third line of the copy-sequence-begin template. Instead, this template was 
changed so that it now seemed to mark the end of the organism. 


An organism with this mutation calculates its size as only 45 and copies 
only its first 45 lines when it replicates -- thus producing a truncated 
organism with no copying code. However, the 45 can recognize the copy 
template of any other nearby organism, and can execute that code instead. 
Thus, it is a parasite, using another organism's code to reproduce itself. 
On the other hand, it’s not a parasite in the sense of taking anything from 
the host, since the code is reusable and the parasite uses its own CPU time. 
(By contrast, the co-evolving "parasites" in the Hillis experiment noted on 
page 5 were really co-evolving problems -- or fitness conditions -- rather 
than organisms that used the hosts’ code, let alone their resources.) 


1 From page 11: "In the same way, words with random changes to letters 
don’t usually end up making much sense." 
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How did the "45" get so lucky as to have precisely this mutation? Well, 
organisms with other, less useful mutations died out, of course. We see 
only the organisms that survived. Most ones that split in other places 

didn’t survive beyond a single generation, since they couldn't reproduce. 


Paradise for parasites 


Typically, such successful parasites emerged within a few million instruc- 
tions, or 10 generations. The parasite proliferates more rapidly since it 
uses less machine time to reproduce -- only 489 steps instead of 827. 


These "45" parasites, of course, depend on healthy "80s" for their replica- 
tion code. Meanwhile, in some cases, "45"-resistant "79s" appear. Ray 
isn’t sure what makes them resistant, but they somehow seem to forget their 
size after each replication, and thus need to re-examine themselves as they 
copy each line. This would keep out parasites, but it has a high metabolic 
cost since it adds a step for each of the 80 lines replicated. Thus, if the 
79s appear along with the 45s, the 45s have trouble getting established, 
while they live nicely off the 80s. (The 45s don’t really take anything 
directly from the 80s, although they have an advantage of a much shorter 
reproduction cycle and end up taking over a larger and larger proportion of 
memory as they proliferate. However, they can’t survive without 80s within 
addressing distance, so the proportion self-regulates.) Another organism, 
5laao, was able to circumvent the 79s’ immunity in another run, but Ray 
hasn’t yet figured out how it did so. 


Finally, there are hyperparasites, which seize control from parasites. When 
a parasite uses their code to reproduce, the hyperparasite seems to let the 
parasite do so. But it changes the parasite’s own pointers, so that the 
parasite thereafter replicates the hyperparasite rather than itself. Thus 
the hyperparasite reproduces itself, while also subverting nearby parasites 
to do the same. Thus the parasite spends the rest of its lifetime and its 
"metabolism" making copies of the hyperparasite. 


No sex, please! We’re Tierran 


The hyperparasites quickly wipe out the parasites, and the community becomes 
genetically uniform for a while. Such conditions, notes Ray, support the 
evolution of "sociality," or altruism, where hyperparasites rely on their 
own kind. One example is 6laai, which can replicate only when it’s sur- 
rounded by similar cooperating organisms; basically, the tail of one acts 
like the head of the next one -- as long as they’re next to each other. One 
factor in favor of such sociality is size reduction: The "61s" are only 
three-quarters the size of the ancestor, and can reproduce more quickly. 


Another exotic creature was missing the template that marked its end, but it 
had developed (or rather the one that had developed the following had sur- 
vived) a clever way of determining its size for reproduction: It took the 
beginning template and a template in the middle. The beginning was sub- 
tracted from the middle to determine the organism’s size, and this value was 
multiplied by two by shifting the number one space left (which amounts to 
doubling in binary). This, of course, is a bizarre sequence, but it happens 
to work -- and thus it survived, while other variants of the endless organ- 
ism died off. 
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SE s ae ee a ne a 
These creatures all evolved during a few initial runs of about a billion in- 
structions. Another, longer run of 15 billion instructions didn’t get the 
full examination, but Ray did find one novel creature there that had figured 
out how to "unroll the loop." Basically, it avoids a certain amount of 
overhead in the copying process by copying three lines in a single pass. 
Although the number of instructions in the loop is 22 instead of 18, the 
loop is used fewer times to accomplish the copying of the entire organism. 


While Ray did not include sex per se (or crossover of genetic material) in 
his design of the system, it more or less evolved spontaneously. Organisms 
started using each other's code (which is also their genetic material), and 
others in fact copied it and incorporated it as their own. This is somewhat 
irregular as far as sex goes, but it ends up accomplishing the same function 
of sharing genetic material. Perhaps sex itself was originally "irregular." 
Even today, notes Ray, bacteria still practice this primitive form of sex, 
somewhat randomly sharing genetic material. (There's a point of view that 
considers males to be a virus afflicting females, but that’s another story.) 


For further experimentation... 


With the exceptions noted, all this comes from detailed examination of a few 
overnight runs of Tierra. Ray hasn’t yet had the time to analyze in depth 
approximately 40 other runs of several thousand generations each, with dif- 
ferent parameters such as mutation rate, search space size and allocation of 
cycle time. These other control runs have shown that the basic run was not 
especially unusual, but none of the runs have lasted more than a few thou- 
sand generations. It’s clear that arrangements favoring smaller creatures 
favor parasites, but beyond that there’s a wealth of empirical data to gen- 
erate and study. In the experiments so far the entire population died out 
only twice, when Ray had set an unusually high rate of mutation. 


The first thing any practical person will notice about Ray’s 
organisms is that they don’t do anything useful. They simply 
multiply and consume machine resources. In a “pure” environ- 
ment, useful software might take years (even on a Connection 
Machine) to evolve naturally. But that begs the question: 

What is useful? And useful to whom? The way to make it useful 
to us, obviously, is to get in there and reward the useful 
software. Is this a market or evolution? Both, of course. 


The amazing thing about Tierra so far is that it’s working exactly as one 
might expect in broad overview: Evolution works. The next interesting 
question is what will happen over longer periods of time and a variety of 
runs. The 40 control runs indicate that life is indeed robust. The details 
may vary, but something happens each time. Was the one-bit difference be- 
tween the copy template and the end-of-me template necessary? Try it an- 
other way and see... 


Now Ray is about to spend seven months at the Santa Fe Institute. His pri- 
mary goal is simply to explore Tierra some more and ~- a luxury not given to 
most biologists -- to explore its permutations. Currently, with assistant 
Dan Pirone, he’s working on improving analysis tools. A run of a few thou- 
sand generations can be completed overnight but takes months to analyze. 
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In addition, Ray wants to add multi-cellular organisms and increase the in- 
struction set without sacrificing his creatures’ evolvability. In this con- 
text, a multi-cellular organism is one with specialized functions, for exam- 
ple, code sections for searching for mates or food, or defending against 
predators. He hopes and expects to see an analogue of the earth's Cambrian 
period, a Gamelot for evolutionary biologists when the world exploded with 
new and diverse species -- probably as a result of multi-cellular architec- 
ture and the discovery of sexual reproduction. 


Will the Cambrian explosion happen by itself? Our natural assumption is 
that to get an ALife system to do anything useful we have to start setting 
it problems. But could it simply come to us with some ideas? The likeli- 
hood is low -- not because the system is incapable of doing so, but because 
we don't have the time to sift its right answers from all its wrong ones. 
Thus we probably need to give the system an automated proxy for ourselves in 
the form of fitness conditions or some other measure of success. 


How it might apply 


For the long run, Ray dreams of coordinating (or fostering self-coordination 
of) applications on massively parallel computers. But programming by evolu- 
tion isn’t a hands-off, labor-free process, any more than training "self- 
learning" people or breeding plants is. There’s a delicate trade-off be- 
tween relying on evolution and boosting the process along with hints. In 
order to "direct" evolution, you have to state the criteria for success ap- 
propriately. You will get what you ask for, so ask for it carefully. 


The practical issues include defining the problem (and it must be complex 
enough, since frequently in programming defining the problem more or less 
solves it}, recognizing the solutions, and so forth. In some sense, of 
course, if success is easy to state, it may be easy to code -- which is why 
optimization, rather than implementation of new solutions, is one of the ob- 
vious roles of programming by evolution. The "answer" tends to be the ar- 
rangement that produces the shortest time or the algorithm that keeps the 
plant efficient doing a well-defined task (or a model that correctly pre- 
dicts behavior). As an external force with intentions (rather than a re- 
search scientist content to watch), a code breeder can always start out with 
code that needs improvement rather than from-scratch creation. 


By stating success too narrowly or providing to much of a head start, how- 
ever, you may restrict the ability of evolution to be creative. For exam- 
ple, evolution did not require that animals fly or swim, but rather that 
they move quickly enough to escape predators and catch prey, which led to 
swimming, flying, kangaroo-jumping, slithering, burrowing and other forms of 
rapid retreat (or quick advance). 


2 Suppose, just for example, you decide to leave the system on for several 
years without disturbance. The system sits alone in a locked room, uncon- 
nected to anything else (for safety), monitored only by a janitor who makes 
a daily visit. His task is to check that the machine is still running, look 
at the screen, and leave it alone. But the janitor is a moonlighting gradu- 
ate student. One day the screen has a message, and he answers it... Is the 
student endogenous or exogenous? 
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Tierra’s creatures, for example, discovered the common programming technique 
of unrolling the loop. They also did some weird but practical things, like 
subtracting one from an odd number by switching the last bit from 1 to 0: 

It works, but it’s not "intentional" subtraction. It is a "dumb" shortcut 
that in the context does the right thing -- like summing the digits to see 
if a number is divisible by three (in the context of base 10 only). 


On the other hand, an unprepped system is unlikely to come up with English- 
language messages very easily. While it could easily generate them, it 
would need an English speaker to react to them; the problem isn’t in the 
system's ability to learn to speak English through trial-and-error, but in 
finding a training system to interact with it. (Take the million monkeys 
typing Shakespeare: They can easily do it, but no one has the time to comb 
through their output to separate the Shakespeare from the PC Magazine, the 
Bruce Sterling and the pure gibberish.) For practical purposes, just give 
it the English... 


Questions of hygiene surround adaptive computation: How do you 
define success? That's easy for optimization, but less easy 
for evolving solutions to complex problems. It’s easy to 
select for survival; much harder to posit a fitness function 
for a problem where stating the problem is the problem. But 
real success is unpredictable: If adaptive computation is 
generate-and-search, what are you searching for? 


Uses of programming by evolution 


So what will PBE be good for? It will be more useful for tasks with answers 
that can be recognized by a program, even if they can’t be explicitly de- 
fined. Aside from optimization and pattern recognition, examples include 
all kinds of design: of physical, chemical, medical, temporal (scheduling) 
and software systems. In short, PBE can be used to design novel ways to 
solve problems, as long as there is a way to specify or simulate the problem 
and to recognize an acceptable or better solution. (Basically, anything 
that must be designed to match constraints qualifies; the constraints are 
the fitness conditions.) While "design" might sound like the limited pro- 
vince of a number of different kinds of professionals, it will in fact be 
the great challenge of the next decade. As it becomes increasingly easy to 
automate production and even information systems, the remaining unresolved 
problem is how best to design those systems that we can so easily automate. 


For example, you might want to plan schedules. You would need to define the 
parameters involved, generate thousands of sample event sets to be schedul- 
ed, and define success. The problems should be soluble, success should be 
recognizable, but hard enough so that the poor systems get removed quickly. 


Unlike ordinary code, however, evolved code comes without documentation and 
may be cryptic yet verbose in the extreme, mingling brilliance with redun- 
dancy or even uselessness. In short, it’s not stuff you want to fool around 
with; it’s the ultimate in a black box. On the other hand, it can change 
itself by itself (if you trust it). Give it new parameters for success, and 
it will respond. It may even start responding before humans notice that the 
parameters have changed (for example, subtle changes in patterns of credit- 
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worthiness, stresses on a building or job qualifications}. The trick is 
making sure that it gets the relevant input. 


Just as in other fields, PBE customers may buy tools or they may buy fin- 
ished products. In other words, they may buy fully evolved, tested tools, 
or they may buy an adaptive system specialized for a certain problem type 
and evolve it to meet their particular goals. Middle-vendors -- consultants 
and the like -- will get into the act, knowing how best to state a problem 
and the criteria for its solution in order to evolve a system solution for 
use by clients. 


For more on the useful application of genetic algorithms, please wait for 
our May issue. 


INTERLUDE: NATURE VS. ART 
Why is computer-based artificial life "artificial"? And why is it "life"? 


It's artificial at first glance because it's electronic rather than chemi- 
cal, let alone carbon-based. The life we know is wet and tangible. But 
that may be an accident rather than an inherent feature of life itself. 


The second, now accepted, reason to classify ALife as artificial is that it 
generally was originated "artificially" by some external agent and depends 
on externally imposed criteria of fitness rather than on its own urge and 
capabilities to survive. Does Tom Ray's Tierra, then, hold almost-natural 
electronic life within a computer? (Could its distant descendants be natu- 
val?) Is a computer virus run amok "natural" life? One might well say so. 
Conversely, are domestic animals artificial? (The premise, of course, is 
that all the intentions we perceive in ourselves are really just expressions 
of our basic will to live and reproduce, an interesting philosophical debate 
but not relevant here.) 


Meanwhile, what is "life"? Generally, we consider life to be a self- 


organizing force, regardless of what it organizes. By that definition, most 
of the foregoing is "alive." 


But what about markets, then? Are they alive in any sense? 


Overall, the point is not the definitions but their implications. This is a 
new field, after all, and it is complicated by evolving terminology. May 
the fittest terms survive (under the externally imposed fitness functions of 
scientific research)! 


Evolution is long-term; a market is short-term. The difference 
is only a matter of time -- and of genes versus memes. 
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ARTIFICIAL MARKETS: HOLLAND’S ECHO MODEL 


Seemingly distinct from programming by evolution is the whole area of model- 
ing. Models can be used to predict or analyze real-world systems, or to 
model the behavior of markets, among other things. However, what looks like 
a market from one perspective looks like an evolving system from another. 


Another project at Santa Fe (shared with the University of Michigan) is John 
Holland's Echo world/model, which happens to run on a Mac in its current in- 
carnation. Holland is known for developing the basic theory and practice of 
genetic algorithms. 


The issue in Echo isn’t survival or evolution alone, but the dynamics of 
survival in an ecosystem or marketplace. Unlike Tierra, Echo has different 
kinds of resources and a lot of complex behavior built in; Holland’s goal is 
to study the dynamics of the system rather than to foster evolution. In- 
stead of success or failure, the model focuses on the use of resources and 
the "evolution" of behavior rather than of individuals. With trading and 
combat, there are ways other than genetic crossover and mutation to disperse 
what Holland calls building blocks of behavior through a system. (Some 
might call them memes, or behavior/skills that can be passed on culturally 
rather than genetically, such as ideas, techniques or fashions.) 


Echo’s basic philosophy is "Try anything -- in particular!" Echo allows its 
users to specify very particular initial conditions; an experimenter can try 
out a variety of parameters, rules of behavior, constraints and other condi- 
tions and watch their effects. While Ray plays an aloof god, Holland is 
closer to Greek mythology, where the gods took an active, meddlesome part in 
earthly affairs. Ray leaves his system alone, Koza (in our May issue) en- 
courages his organisms to evolve in specific directions, whereas Holland 
changes local rules to see what happens globally. 


Echo is a simple ecosystem simulation which implements the basic notions of 
ecology -- food, competition, mating and trading -- and allows you to build 
a model with arbitrary rules. Its organisms, or agents, live on a diet of 
letters. The letters represent a selection of not completely fungible 
resources; that is, you can trade clothing for bread, but you can’t live on 
bread alone. You need to find someone willing to trade clothes for bread. 
Some letters come into the system on a regular basis at specific sites (much 
as sunlight provides both energy and food through its support of plant 
growth). Where and how many letters enter the system, the extent to which 
they can be reused and other parameters are variable. The agents can move 
from site to site depending on conditions they find favorable (e.g. less 
competition or different kinds of resources). 


The agents can fight each other, trade with each other or mate with each 
other; each activity generally involves the transfer of some letters. (The 
system, initially mating- and combat-only, got dramatically more efficient 
when he added trading, notes Holland.) Each agent has visible "tag chromo- 
somes" made of letters to declare its external, phenotypic features, such as 
its criteria for mating, fighting or trading. It also has internal "condi- 
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tion chromosomes," which govern its behavior in response to the tags of 
other agents. By altering any of these slightly, you can dramatically 
change the outcomes. 


A matter of metas 


Holland’s latest work involves creating a hierarchy of organisms with "meta- 
zoans," or discrete colonies of individual organisms that stick together and 
act as units, by changing the rules to let individuals band together. 

Within these metazoans, the individual organisms start to specialize: Some 
collect letters; others get exceptionally good at combat. Now these collec 
tions represent atomic units at a higher level in the hierarchy. Overall, 
the organisms in the units survive more effectively as specialists within an 
organization. They exhibit a diverse range of complex behaviors, says Hol- 
land, ranging from ecological phenomena such as mimicry and biological “arms 
races," immune system responses, with interactions conditioned on identifi- 
cation, evolution of the metazoans as their components become specialized 
and develop unique behaviors, and even economic phenomena such as trading 
groups and the emergence of "money," or the use of commodities for storing 
value and trading rather than for consumption. Holland hasn't yet seen the 
emergence of trading goods or money in Echo, but he fully expects to, citing 
work by John Miller of the Institute and various others. See page 22. 


Do you want sex? Combat? Pick one trading rule from column A 
and one from column B. Fill in the desired mutation rate here. 


What mating strategies work best: How much of a surplus should you collect 
before you reproduce? And so forth. Holland finds that the most stable 
populations are those comprising organisms with a variety of strategies. Do 
cooperators or fighters tend to crowd each other out? Frequently, systems 
start with defectors but they keep harming each other and are generally 
overrun by cooperators -- but not always. What makes the difference? 


Making math out of magic 


In the study of GAs, the underlying mathematical construct is the schema 
(see next page); in artificial evolution, until recently, there have gener- 
ally been discrete, exogenous fitness functions (however complex). In natu- 
ral evolution, there’s a bottom line: Genes survive or go extinct, although 
that process may lead to extraordinarily clever, complex, seemingly engi- 
neered responses. The purpose of. Echo is to explore what happens above the 


3 We are particularly interested in the evolution of money within what 
amounts to a barter economy because of our work in Central Europe and the 
soviet units. In Russia, people are now out in force trading in the 
streets, creating huge traffic problems. The government has declared that 
such activity is legal, and response has been quick. Some people are at- 
tempting to make profits, while others are selling heirlooms for food. 

While Russia has a currency, the rouble, its soundness and value have always 
been questionable, and other stores of value such as pes (serious money) and 
Marlboros (for small transactions) arose spontaneously. 
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bottom line, where the underlying mathematical constructs are even more 
obscure. The basic analytical approach is to visualize the strategies and 
flows of resources and in conjunction with various behavior. How do the 
various strategies interact? 


In Echo, as in markets in general, agents are competing against each other 
and the determinants of fitness keep changing (as they do in a complex, 
realistic world such as Tierra or any system where agents interact). More- 
over, the system succeeds as a whole, by becoming more efficient, in a man- 
ner correlated with but not completely dependent on the success of individu- 
al agents. Basically, "progress" in a market is measured in terms of ef- 
ficiency of use of resources: How effectively are they distributed, organ- 
ized and used to increase the organization of new resources? 9If you're 
looking at this from a social point of view, perhaps you want to somehow 
factor in elements of faith, fun or attention; cf. Release 1.0, 3-92. If 
you can measure them, you can of course optimize for them, too.) 


Schemata: Did you marry me for my cooking or my money? 


It’s a truism that evolution doesn’t select for genes directly; 
rather, it selects entities with successful features (or pheno- 
types), which are somehow correlated to the underlying genes. How- 
ever, it isn't always clear which features, let alone which genes, 
lead to success. Moreover, some genes and features are successful 
only when they are combined, or when they are not. Apparent cor- 
relations may be spurious; real correlations may be hidden. If two 
systems are successful and two are not, as an analyst you may look 
for the genes the successful organisms had in common and that the 
unsuccessful ones lacked. But all four may have some genes in com- 
mon, while the genes of the two successes differ. So which ones 
matter? (Besides, you can look at only a random subset of all the 
possibilities. As for evolutionary selection itself, it looks only 
at the outcome, not at any of the causes.) 


A typical schema: 1*0**10*. The ls and Os are genes held in common 
by the successes and absent in the failures. But does each of them 
really lead to success, or is it irrelevant, or even a negative 
overcome by positive effects of other genes? Only with many trials 
ean you reach any conclusions (and can evolution do its work). 


Thus it is the schema, rather than the exact genes, on which evolu- 
tion works its effects. A schema is a pattern of presence, absence 
and don’t care -- of genes. The math of how this works is quite 
complex, but it means that even though selection, recombination and 
variation work directly on individuals, they are in fact manipulat- 
ing the underlying schemata. It is the schemata (which survive 
through generations) that are ultimately being tested, identified 
and proliferated. 


It’s a little like doing math with wild cards, or filling in those 
puzzles where they replace the digits with letters. Only in this 
case, the problems aren't necessarily set up to be solvable. (See 
resources, page 25, for further reading.) 
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With Echo, Holland wants to develop a mathematical framework for describing 
and analyzing the behavior of the model. He’s looking for some of the un- 
derlying constructs -- "building blocks" of rules and resources instead of 
schemata -- that are expressed through behavior strategies and flows of 
resources from one agent to others. 


Echoes of reality 


The goal of Echo is not to build precise data-based mathematical models with 
real data, where the purpose is usually to predict data based on other data. 
Rather, the idea is to build structural models, so that you can see how the 
various parameters and rules interact. The trick is to discover the basic 
patterns, and then to find the underlying local rules that produce them. 
Then, you can vary the rules to construct new models and patterns. 


For example, while it’s easy to model price elasticity, it’s hard to see in 
detail how it's implemented in transactions over time. What are the local 
rules that lead to price elasticity globally? Are there points of discon- 
tinuity in a curve? Furthermore, what comes after price elasticity? What 
are the rules and equations for mating and combat, for example? 


With data there are basically two levels: summary and detail. With adaptive 
computation there are three: detailed data; broad, complex, unpredictable 
patterns that become visible if you know how to look; and the fine-grained, 
simple rules that give rise to the complex patterns when iterated. You 
can’t extrapolate or calculate with a single equation, however complex; you 
have to iterate, with simple equations. 


Levels of understanding 


Each level can be another level in another model. At any given point, you 
can go up or down. For example, a single organism looks like an ecosystem 
or a market when you examine its parts, and an ecosystem looks like a single 
adapting organism from a distance. The interactions of individual discrete 
components change the nature of the system they comprise; it adapts. Ulti- 
mately, the distinction depends on your distance and your point of view. 


The atomic components turn out not to be atomic, but rather to be complex 
organisms themselves, something already familiar to biologists, who deal 
with interacting cells, immune systems, as well as larger "organisms" such 
as bee colonies and economies. Are males and females actually symbionts 
rather than different members of the same species? Are genes actually 
viruses inside other organisms, using those organisms to perpetuate them- 
selves? Or take examples from economics: Is the proper unit a person, a 
company, an industry or a country? Do pen computers compete with pcs, or 
are they a new separate market/species? What are the implications of corpo- 
rate alliances? Will they reduce competitive vigor over time? 


Over the next year, Holland will work on expanding his model, with a focus 
on the metazoans. He also wants to use the resources of Santa Fe Institute 
to build a tool-cum-user interface for building Echo-like models, with the 
assistance of Will "SimCity" Wright, who has been spending time in Santa Fe 
recently. The idea is to let people skilled in some domain of knowledge but 
not in programming build their own models using the basic, generalizable 
components and rules of Echo. Call it SimKit or SIMple. 
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GAS IN HIS EYES 


This tool could well work as the front-end for an ambitious tool proposed by 
Chris Langton, also of the Institute and of nearby Los Alamos National Lab. 
Langton has fanned much of the current interest in artificial life, and or- 
ganized the first three big ALife conferences. He has also formulated the 
notion that life lies on the tenuous boundary between randomness and order, 
or between gas and crystals. 


Langton’s tool could be used to build Echo or a variety of other models, but 
in his vision it runs on a Thinking Machines CM-5, not a Mac. (Of course, 
the fundamental software would be portable anyway.) Its formal name is the 
"process gas simulator," for a simulated gas of processes (rather than inert 
molecules) operating across an ether of processors that could implement the 
processes. He is seeking cooperation and support for the development of the 
process gas simulator from outfits such as Apple, the Human Interface Tech- 
nology Lab in Seattle (see Release 1.0, 10-90), Orbital Sciences Corporation 
(which is working on an OS that could manage processes running across com- 
puters on several hundred satellites), Los Alamos (of course), Sony, UCLA 
and the MIT Media and Mobile Robot labs. All of them are aware of the work 
and have expressed varying degrees of interest. 


THE ORIGINS OF MONEY 


Another project that may make use of the process gas toolkit is theoretical 
economist John Miller’s study of markets. (Miller works at SFI and also in 
Carnegie-Mellon’s department of social and decision sciences.) It is simi- 
lar in some respects to some work at Xerox PARC led by Bernardo Huberman, 
Spawn (see Release 1.0, 6-89). However, Huberman’s work, while real-world, 
has been limited to a single fungible resource of computer time with limited 
variations. He is now looking at issues of specialization and differentia- 
tion, where different network resources have special capabilities such as 
font collections, pre-loaded applications or special co-processors. 


Miller's work is preliminary too at this point. He wants to use the process 
gas modeler to build markets where you have competition not just among buy- 
ers and sellers, but among the markets themselves. For example, which auc- 
tion rules are most effective? (The competition between the Amex, with its 
system of competing market-makers, vs. the New York Stock Exchange, with a 
single market-maker per stock, is an example of this in real life. So are a 
variety of new markets and off-exchange trading organizations. So are the 
various foreign-exchange markets and the new commodity markets in Russia.) 


What makes a good market? Factors include enough centralization that a cri- 
tical mass of buyers and sellers can meet. What about rules for the speed 
of dissemination of information? Can you know too much? How do agents’ 
strategies change over time as they watch the actions of other agents? The 
answers will be relevant among other things to software distribution, espe- 
clally of component software, and also payment schemes and pricing. One 
early example is the American Information Exchange (see Release 1.0, 12-91). 


Many commercial software vendors are working on network management systems 
or object request brokers, building an infrastructure that will ultimately 
allow for decentralized market-style allocation of resources, but we don’t 
yet know of any commercial systems that qualify as truly market-oriented. 
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(Please let us know if you do. Candidates include network OS vendors and 
also Tivoli, Legato, Client Server Technologies and Aggregate Computing.) 


Obviously, these models and issues are exceedingly relevant to all kinds of 
public-policy decisions, both here and in newly market-oriented countries as 
they attempt to set up markets. 


Money is a medium of trust. 
-- Martin Shubik, Yale and SFI 


Money, money, money! 


Mostly working at the Institute, Miller and others have extended some ear- 
lier work on the "“Wicksell triangle," where three agents with different 
goods come up with the concept (or at any rate the implementation) of trad- 
ing commodities. The Wicksell triangle, the work of a 19th-century Scandi- 
navian economist, is well known among economists. But it was developed when 
economics was still more a social than a mathematical science, and it was 
modeled mathematically only in the last few years and only with equilibrium- 
seeking equations. Miller and crew took the work one step farther, modeling 
the triangle with intelligent agents and iterative calculations. 


The agents -- call them Juan, Alice and Bob -- each produce a good they can- 
not personally use -- jute, apples and books, respectively. Worse yet, 
Alice wants Bob’s books, but Bob wants Juan’s jute and Juan wants Alice’s 
apples, so they can’t trade with each other directly. (Does anyone know an 
airline that wants a subscription to Release 1.0? That's why we have 
money.) So how do you encourage the agents to trade for things they don’t 
need? The parameters include the costs of holding goods as well as knowl- 
edge of others’ trading patterns and their own experience. 


Such a system can reach two basic kinds of equilibrium, what the scientists 
call "fundamental" and "speculative." Fundamental equilibrium is easier to 
reach because the cost of holding goods (or discount rate) is low; basical- 
ly, an agent gets an easy payback for cheaply holding a good he can’t use 
and trading it on the next turn. Speculative equilibrium -- we'd prefer to 
call it "investment" -- occurs when the cost of holding the intermediate 
good makes the initial trade look like a bad deal; it requires a higher 
level of knowledge on the part of the agents. Issues include the rate of 
information transfer and the trade-offs between the advantages of such in- 
formation, its reliability and the costs of acquiring it. (See Release 1.0, 
11-91, on transaction costs.) Not yet in the model, but a natural next 
step, are time and money; the "cost of holding a good" is none other than 
the prevailing discount rate. 


Working with genetic algorithms to select successful bidding agents, Miller 
has watched his agents co-evolving better and better bidding strategies. 
Somewhat counterintuitively (at least until you think about it), novice 
agents learn better in the company of agents at a similar level of skill 
rather than with "genius" traders. Rather than learning from perfect play- 
ers, they learn better by making mistakes and occasionally winning. Playing 
against the best, they almost always lose, so there’s no positive feedback, 
and the few times they win it’s because the other side screwed up (not ne- 
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cessarily a good way to learn). It all goes to show the value of feedback, 
and of both trial and error. 


Tournament of tactics 


Miller also recently co-organized the Institute’s $10,000-prize tournament 
for computerized strategies to operate in an auction market similar to the 
NYSE (and most other financial markets). The results were intriguing, says 
Miller. The basic strategy of "lurk in the background and then steal the 
deal" worked best. This is fundamentally an information-parasite strategy, 
where the agent feeds off host strategies doing all the work. Of course, if 
they get too successful (cf. index funds) they have no one to feed off, and 
they stop working so well. On the other hand, complex strategies in general 
do no better than simple ones; most of the successful strategies used only a 
little of the available information (which was free). Waiting and avoiding 
mistakes was the best strategy. 


The model provides some insights into the fundamental question of why supply 
equals demand even with the limited amount of information available in most 
markets. Fundamentally, says Miller, the market works well almost indepen- 
dently of the intelligence of the agents within it; the double auction sys- 
tem -- with buyers’ bids moving up and sellers’ offers moving down -- is a 
powerful way to consolidate information never held by any single agent. 


Metaphorically, the artificial markets could pass a Turing test, says Mil- 
ler; in a statistical sense, they look just like "real" markets. Indeed, 
markets are increasingly becoming electronic. Originally, this was a matter 
of record-keeping. But why not have machines strategize and negotiate the 
trades as well as execute them? -- as Doyne Farmer’s Prediction Company in 
some sense will be doing. "I'll have my agent handle your agent...." But 
first I’ll train my agent in a market simulation. 


MIDTERM REVIEW: MAJOR LESSONS LEARNED 
The major lessons we see in the Institute's work so far are the following: 


@ co-evolution is key. If you simply evolve a system to solve a single 
problem, it ends up solving that single problem very well, but can’t 
generalize effectively. 


e diversity is key. Ecologies and markets function best when they con- 
sist of a variety of parts; the parts function best when they interact 
with a variety of competitors, partners and other counterparts. (In a 
market economy, this is obvious, where people and firms perform dif- 
ferent roles, and buy and sell different products according to dif- 
ferent capabilities and needs.) Evolution does not find a single best 
solution, but keeps many solutions adapting and progressing. 


e the definition of success is key. In all but the strictly stay-alive 
systems, the designer's criteria for success direct the outcome. If 
they are too rigidly defined, the developer will just get back what he 
asked for. The real goal is to be pleasantly surprised with something 
you didn’t ask for. Likewise, the initial algorithms should be fairly 
general. 

-- More next month! 
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RESOURCES & PHONE NUMBERS 


Joan Wrabetz, Aggregate Computing, (612) 546-6059 

John Miller, Garmnegie-Mellon, (412) 268-3229; fax, (412) 268-6938 

Melanie Mitchell, Stephanie Forrest, Tom Ray, Susan Wider, Mike Simmons, 
Bruce Abell, Santa Fe Institute, (505) 984-8800; fax, (505) 982-0565 

Marc Feldman, Stanford, (415) 725-1867; fax, (415) 725-8244 

John Koza, Third Millennium Venture Capital, (415) 941-9137; fax, (415) 941- 
9430 

Lawrence Davis, Tica Associates, (617) 864-2292; fax, (617) 494-4850 

John Holland, University of Michigan, (313) 663-0226; fax, (313) 764-3520 

Bernardo Huberman, Xerox PARC, (415) 812-4147 


For further reading: 


"Genetic programming: On the programming of computers by means of natural 
selection and genetics," by John R. Koza, MIT Press, 1992. 

“Artificial Life I & II: Proceedings volumes VI & X," edited by Chris Lang- 
ton and others, Addison-Wesley, 1989 and 1991. Also, "Artificial 
life: The video," Addison-Wesley, 1991. 

"Artificial life: The quest for a new creation," by Steven Levy, Pantheon 
Books, 1992. 

"Life at the Edge of Chaos," by Roger Lewin, Macmillan, 1992. 

...and a large number of books, papers and other reading from the Santa Fe 
Institute, including papers by all the people mentioned here and a 
description of the Institute's various Adaptive Computation projects. 
(They will happily send you a full listing.) 


COMING SOON 


Adaptive computation part II. 
Knowledge publishing. 

Pen stuff. 

Constraint-based reasoning. 
Commercialization of the Internet. 
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RELEASE 1.0 CALENDAR 


May 3-7 Human factors in computing conference - Monterey. 
Sponsored by ACM. Call Rachel Greiper, (212) 869-7440, 
May 4-5 *Pen-Based computing conference - Boston. Sponsored by 


Digital Consulting. Keynotes by Ed Yourdon and Portia 
Isaacson. Call Kathleen Spencer, (508) 470-3870. 


May 5-7 Nat’l online meeting & CD-ROM gallery - New York City. 
Sponsor: Learned Info. Call Rob Seitz, (914) 632-5686. 
May 5-7 Executive Uniforum symposium - Santa Barbara. "Migrating 


to integrated open systems: Tools, tactics and tradeoffs." 
Sponsored by UniForum, X/Open and Patricia Seybold'’s Office 
Computing Group. Gall Deborah Hay, (617) 742-5200. 

May 6-8 Summit '92 - Newport Beach. The intelligent way to do 
business. Sponsored by MicroVision and Computer Reseller 
News. Call Mickey Dude, (603) 888-5626. 

Hay 13-14 The acceleration of multimedia communications - Stanford. 
Sponsored by The Stanford Center for Telecommunications and 
Accel Partners. Call Brenda Santomauro, (415) 725-0479. 

May 18-22 INTEROP 92 - Washington, DC. Sponsored by Advanced Comput- 
ing Environments/Ziff. Keynote by Mitch Kapor. Call Wendy 
Gibson, (415) 941-3399. 

May 28-31 International summer consumer electronics show - Las Vegas. 
Sponsor: Electronic Industries Association. Call Mark 
Rosenker, (202) 457-4980. 

May 31-June 2 ATRE ~ Sahoro, Japan. Executives meet. Sponsored by 
Dasar. Call Alex Vieux, (415) 321-5544. 

May 31-June 3 *SPA Europe's third annual conference - Cannes, France. By 
Europeans, for Europeans, Americans invited. Sponsor: Soft- 
ware Publishers Association. Call Ken Wasch, (202) 452-1600 
or Viviane Lemonnier, 33 (1) 4692-2704; fax, 4692-2531. 


June 1-3 Collaboration ‘92 - San Francisco. Sponsor: Graphic Commu- 
nications Association. Call Marion Elledge, (703) 519-8160. 
June 1-4 PenExpo - Santa Clara. Co-sponsored by Boston University 


Corporate Education Center and PenWorld. Cail Bob Bevan, 
(508) 649-9731 or (800) 733-3593. 

June 1-5 FGGS "92 - Tokyo. Sponsor: Institute for New Generation 
Computer Technology. Contact: Hidehiko Tanaka, 81 (3) 3456- 
3195; fax, 81 (3) 3456-1618; e-mail, fgcs92@icot.or.jp. 

June 3-5 Advanced technology summit - Chicago. Sponsored by New 
Science Associates. Speakers include Jim Manzi, David 
House, Phil Neches. Call Tracy Robinson, (203) 259-1661. 

June 7-11 International joint conference on neural networks °92 - 
Baltimore. Sponsored by the International Neural Network 

_ Society and IEEE. Call Gail Reed, (619) 453-6222, 

June 15-19 Artificial Life III - Santa Fe. Sponsored by the Santa Fe 
Institute. How to grow your own. (See this issue.) Call 
Christopher Langton, (505) 984-8800. 

June 5 Symposium and open house of the Human-Computer Interaction 
Laboratory - College Park, MD. Sponsored by the University 
of Maryland Center for Automation Research. With Ben 
Shneiderman. Call Gary Marchionini, (301) 405-2053, 
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*International Computer Forum - Moscow. Sponsored by the 
International Computer Club. Call Levon Amdilyan, 7 (095) 
921-0902, or "Levon" on MCI mail at 439-1034; or Esther 
Dyson at (212) 758-3434. 

New York PC user group meeting - New York City. Sponsor: 
NYPC UG. With Jim Manzi. Call Jim McMullen, (914) 245-2734. 
*PC EXPO - New York City. Sponsored by Bruno Blenheim. 
Gall Annie Scully, (201) 346-1400 or (800) 829-3976. 
Digital World '92 - Beverly Hills. Sponsored by Seybold 
Seminars. Call Beth Sadler or Kevin Howard, (310) 457-5850. 
Intergalactic user group officers conference - New York 
City. Sponsors: NYPC & Big Apple User Group, New York 
Amateur Computer Club. Call Joe Rigo, (212) 249-6418. 
ECOOP °92 - Utrecht, Netherlands. Sponsored by Software 
Engineering Research Center. Contact: Gert Florijn, 31 
(30) 322640; fax, 31 (30) 341249; e-mail, ecoop92@serc.nl. 
*First international conference & exhibition on advanced 
service and HelpDesk automation - Strasbourg, France. 
Sponsor: Applied Workstations and ServiceWare. Contact: 
Jeff Pepper, (412) 826-1158; Tim Lewis, 44 (306) 77331; 
fax, (306) 77696. 

Case "92 - Montreal. Sponsored by International Workshop 
on CASE and IEEE. Contact: Francois Coallier, (514) 468- 
5523; fax, (514) 647-3163. 

AAAT/TAAT °92 - San Jose. Sponsor: American Association 
for AI. Call Mary Livingston, (415) 328-3123. 

*Object Expo Europe - London. Sponsor: SIGS Publications. 
Call Jennifer Fisher, (212) 274-0640; fax, (212) 274-0646. 
*Object World - San Francisco. Co-sponsored by The Object 
Management Group and World Expo Corp. Businesspeople’s an- 
swer to OOPSLA. Call Bill Hoffman, (508) 820-4300. 

ComNet - San Francisco. Sponsored by World Expo Corp. Call 
Rachel Winett, (508) 879-6700. 

Siggraph "92 - Chicago. The major computer graphics shows. 
Sponsored by ACM/Siggraph. Call Ann Leuck, (312) 644-6610. 
*GroupWare °92 - San Jose. Sponsored by Lotus Development 
and SRI International. With Jim Manzi, Philippe Kahn, Ray 
Noorda, Irene Greif, Thomas Malone and Esther Dyson. Cal! 
David Goleman, (415) 282-9151 or (800) 247-6262. 

LUV-92, (LISP users and vendors) - San Diego. Sponsor: 
Ass'n of LISP Users. Gall Laura Lotz, (215) 651-2990. 
International BBS and electronic comm’s conference - Den- 
ver. Sponsor: IBEGC. Cail Terry Travis, (303) 426-1847. 
*GeoCon/92 - Cambridge. Sponsored by Soft-:Letter. Interna- 
tional product showcase. Call Jeff Tarter, (617) 924-3944, 
Windows & OS/2 conference - Boston. Sponsored by CM Ven- 
tures. Call Stan Politi, (510) 601-5000. 

*Downsizing EXPO - San Francisco. Sponsored by Digital 


“Consulting. Call Debbie Silverman, (508) 470-3870. 


*12th World Computer Congress - Madrid. Ideas, not prod- 
ucts. Sponsor: International Federation of Information Pro- 
cessing Societies. Gall Richard Schwartz, 33 (1) 4629-3640. 


Please let us know about any other events we should include. 
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